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IN THE CLAIMS: 

This listing supersedes and replaces all prior claim listings. Please amend claim 21 as 
follows: 

1 . (Previously Presented) An image generating system, comprising: 

a database which stores first shape data which represents a three dimensional shape of a 

first area including at least a part of an object area in a real world; 

a camera which shoots a second area including at least a part of the object area; and 
an image generating apparatus which generates an image of the object area using a 

picture shot by the camera and the first shape data, wherein said image generating apparatus 

includes: 

a data acquiring unit which acquires the first shape data from said database; 

a picture acquiring unit which acquires the picture from said camera; 

a first generating unit which generates an image of the first area by setting a 
predetermined viewpoint and a view direction and rendering the first shape data; 

a second generating unit which generates an image of the second area when 
viewed from the viewpoint toward the view direction by using the picture; and 

a compositing unit which composites the image of the first area with the image 
of the second area to generate the image of the object area, 

wherein the compositing unit generates an image of the object area, by 
complementing an area in the object area not shot by the camera with the image of the 
first area generated from the first shape data. 



-2- 



00518305 



U.S. Appln. No. 10/780,303 

Response to Office Action dated January 4, 2008 



PATENT 
450137-05004 



2. (Original) An image generating system according to claim 1 , wherein: 

said image generating system includes a plurality of cameras located at a plurality of 
positions; 

said image generating apparatus further comprises a calculating unit which calculates 
second shape data which represents a three dimensional shape of the second area using a 
plurality of the pictures acquired from said plurality of cameras; 

said second generating unit sets the viewpoint and the view direction and renders the 
second shape data to generate the image of the second area. 

3. (Cancelled). 

4. (Original) An image generating system according to claim 2, wherein: 

said second generating unit renders the area which is not represented by the second 
shape data with a transparent color when rendering the second shape data; 

said compositing unit generates the image of the object area by overwriting the image of 
the second area with the image of the first area. 

5. (Original) An image generating system according to claim 1 wherein said database stores 
the first shape data obtained by modeling an area which does not change in a short term in the 
object area. 
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6. (Original) An image generating system according to claim 2 wherein said database stores 
the first shape data obtained by modeling an area which does not change in a short term in the 
object area. 

7. (Original) An image generating system according to claim 3 wherein said database stores 
the first shape data obtained by modeling an area which does not change in a short term in the 
object area. 

8. (Original) An image generating system according to claim 4 wherein said database stores 
the first shape data obtained by modeling an area which does not change in a short term in the 
object area. 

9. (Original) An image generating system according to claim 1, wherein: 

said database stores first color data which represents a color of the first area; 

said image generating apparatus further includes a lighting calculating unit which 
calculates a situation of a lighting in the picture shot by comparing the first color data acquired 
from said database with color data of the picture shot. 

10. (Original) An image generating system according to claim 2, wherein: 

said database stores first color data which represents a color of the first area; 

said image generating apparatus further includes a lighting calculating unit which 
calculates a situation of a lighting in the picture shot by comparing the first color data acquired 
from said database with color data of the picture shot. 
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1 1 . (Original) An image generating system according to claim 3, wherein: 

said database stores first color data which represents a color of the first area; 

said image generating apparatus further includes a lighting calculating unit which 
calculates a situation of a lighting in the picture shot by comparing the first color data acquired 
from said database with color data of the picture shot. 

12. (Original) An image generating system according to claim 4, wherein: 

said database stores first color data which represents a color of the first area; 

said image generating apparatus further includes a lighting calculating unit which 
calculates a situation of a lighting in the picture shot by comparing the first color data acquired 
from said database with color data of the picture shot. 

13. (Original) An image generating system according to claim 5, wherein: 

said database stores first color data which represents a color of the first area; 

said image generating apparatus further includes a lighting calculating unit which 
calculates a situation of a lighting in the picture shot by comparing the first color data acquired 
from said database with color data of the picture shot. 

14. (Original) An image generating system according to claim 9 wherein said first generating 
unit adds an effect of lighting similar to the lighting in the picture shot to the image of the first 
area in consideration of the situation of the lighting. 
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15. (Original) An image generating system according to claim 9, wherein: 

said first generating unit adds a predetermined effect of lighting to the image of the first 

area; 

said second generating unit adds the predetermined effect of lighting to the image of the 
second area, after once removing the effect of lighting from the image of the second area. 

16. (Original) An image generating system according to claim 1, wherein: 

said image generating system further comprises a recording apparatus which stores the 
picture shot, 

said database stores a plurality of the first shape data corresponding to the object areas 
of a plurality of times; 

said image generating apparatus further includes: 

a first selecting unit which selects the first shape data to be acquired by the 
data acquiring unit among the plurality of the first shape data stored in said database; 

a second selecting unit which selects the picture shot to be acquired by the 
picture acquiring unit among the pictures stored in said recording apparatus. 

17. (Original) an image generating system according to claim 16 wherein said second 
selecting unit selects the first shape data corresponding to the time when the picture selected by 
said first selecting unit was shot. 

18. (Previously Presented) An image generating apparatus, comprising: 
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a data acquiring unit which acquires first shape data which represents a three 
dimensional shape of a first area including at least one part of an object area in a real world from 
a database which stores the first shape data; 

a picture acquiring unit which acquires a picture of a second area including at least one 
part of the object area shot by a plurality of cameras located at a plurality of positions from the 
cameras; 

a first generating unit which generates an image of the first area by setting a 
predetermined viewpoint and a view direction and rendering the first shape data; 

a second generating unit which generates an image of the second area when viewed 
from the viewpoint toward the view direction by using the picture shot; and 

a compositing unit which composites the image of the first area with the image of the 
second area to generate the image of the object area, 

wherein the compositing unit generates an image of the object area, by complementing 
an area in the object area not shot by the camera with the image of the first area generated from 
the first shape data. 

19. (Previously Presented) An image generating method, comprising the steps of: 

acquiring first shape data which represents a three dimensional shape of a first area 
including at least one part of an object area in a real world from a database which stores the first 
shape data; 

acquiring a picture of a second area including at least one part of the object area shot 
from a plurality of positions; 
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generating an image of the first area by setting a predetermined viewpoint and a view 
direction and rendering the first shape data; 

generating an image of the second area when viewed from the viewpoint toward the 
view direction by using the picture shot; and 

compositing the image of the first area with the image of the second area to generate the 
image of the object area, 

wherein the compositing generates an image of the object area, by complementing an 
area in the object area not shot by the camera with the image of the first area generated from the 
first shape data. 

20. (Cancelled). 

2 1 . (Currently Amended) A computer program product , encoded on a computer readable 
medium, for generating an image comprising computer readable instructions for performing the 
steps of: 

acquiring first shape data which represents a three dimensional shape of a first area 
including at least one part of an object area in a real world from a database which stores the first 
shape data; 

acquiring a picture of a second area including at least one part of the object area shot 
from a plurality of positions; 

generating an image of the first area by setting a predetermined viewpoint and a view 
direction and rendering the first shape data; 
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generating an image of the second area when seeing from the viewpoint toward the view 
direction by using the picture shot; and 

compositing the image of the first area with the image of the second area to generate the 
image of the object area, 

wherein the step of compositing generates an image of the object area, by 
complementing an area in the object area not shot by the camera with the image of the first area 
generated from the first shape data. 

22. (Previously Presented) A computer-readable recording medium which stores a program 
executable by a computer, the program for generating an image performing the steps of: 

acquiring first shape data which represents a three dimensional shape of a first area 
including at least one part of an object area in a real world from a database which stores the first 
shape data; 

acquiring a picture of a second area including at least one part of the object area shot 
from a plurality of positions; 

generating an image of the first area by setting a predetermined viewpoint and a view 
direction and rendering the first shape data; 

generating an image of the second area when seeing from the viewpoint toward the view 
direction by using the picture shot; and 

compositing the image of the first area with the image of the second area to generate the 
image of the object area, 
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wherein the step of compositing generates an image of the object area, by 

complementing an area in the object area not shot by the camera with the image of the first area 

generated from the first shape data. 
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